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Abstract 

We continue development of the theory of contractive Markov systems 
(CMSs) initiated in m In this paper, we extend some results from m, 
CH], m and m to the case of contractive Markov systems which have 
probabilities with a square summable variation by using some ideas of A. 
Johansson and A. Oberg m- In particular, we show that an irreducible 
CMS has a unique invariant Borel probability measure if the vertex sets 
form an open partition of the state space and the restrictions of the prob¬ 
ability functions on their vertex sets have a square summable variation 
and are bounded away from zero/ 


1 Introduction 


In we introduced a theory of contractive Markov systems (CMS) which 
provides a unifying framework in so-called ’fractal’ geometry. It extends the 
known theory of iterated function systems (IPS) with place dependent probabil¬ 
ities, which are contractive on average, mini in a way that it also covers graph 
directed constructions of ’fractal’ sets m In particular, Markov chains associ¬ 
ated with such systems naturally extend finite Markov chains and inherit some 
of their properties. 

By a Markov system we mean a structure on a metric space which generates a 
Markov process on it and is given by a family 

{K,(e).We,Pe)^^E 

(see Fig. 1) where E is the set of edges of a finite directed (multi)graph (V, E, i, t) 
(V := {!,..., V} is the set of vertices of the directed (multi)graph (we do not 
exclude the case N = 1), i : E —> V is a map indicating the initial vertex 

^MSC 2000: 60J05, 37D35, 37A50, 37H99, 28A80. Keywords: contractive Markov 
systems (CMS), iterated function systems (IPS) with place-dependent probabilities, 
random systems with complete connections, ^-measures, Markov chains, equilibrium 
states, fractals. 
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of each edge and t : E —> F is a map indicating the terminal vertex of each 
edge), Ki, K 2 , ■■■, Kn is a partition of a metric space {K,d) into non-empty 
Borel subsets, {we)eGE is a family of Borel measurable self-maps on the metric 
space such that We C -ftit(e) for all e G i? and {pe)eeE is a family of 

Borel measurable probability functions on K (i.e. Pe{x) > 0 for a\\ e G E and 
'^e^EPe(x) = 1 for all X G K) (associated with the maps) such that each Pe is 
zero on the complement of i^i(e). 


N = i K 2 



Ki 


Wez 


Ks 


Figure 1. A Markov system. 


A Markov system is called irreducible or aperiodic iff its directed graph is irre¬ 
ducible or aperiodic respectively. 

We call a Markov system contractive with an average con¬ 

tracting rate 0 < a < 1 iff it satisfies the following condition of contractiveness 
on average 

Pe(x)d{weX, Wev) < ad{x, y) for all x,y G Ki, i = 1,..., N. (1) 

eeE 


This condition was discovered by Richard Isaac in 1961 for the case = 1 [Jj. 

A Markov system determines a Markov operator U on the set 

of all bounded Borel measurable functions C^{K) by 

Uf :='^Pef o We for all / G C°{K) 

eGE 

and its adjoint operator U* on the set of all Borel probability measures P{K) 
by 

U*v{f) := f U{f)dv for all / G C°{K) and v G P{K). 
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Remark 1 Note that each map We and each probability Pe need to be defined 
only on the corresponding vertex set . This is sufficient for the condition 
m and the definition of U*. For the definition of U, we can consider each We 
to be extended on the whole space K arbitrarily and each pe to be extended on 
K by zero. 

Also, the situation applies where each vertex set Ki has its own metric di. In 
this case, one can set 


di{x,y) ifx,y€Ki 


d{x,y) = 


oo otherwise 


and use the convention 0 x oo = 0. 

We say a probability measure p is an invariant probability measure of the Markov 
system iff it is a stationary initial distribution of the associated Markov process, 

i.e. 


A Borel probability measure p is called attractive measure of the CMS if 


p for all e P{K), 


where w* means weak* convergence. Note that an attractive probability mea¬ 
sure is a unique invariant probability measure of the CMS if U maps continuous 
functions on continuous functions. We will denote the space of all bounded 
continuous functions by Cb{K). 

The main result in jlH] concerning the uniqueness of the invariant measure is 
the following (see Lemma 1 and Theorem 2 in d) (see also m for the case of 
constant probabilities _Pe|ifi(e) and compact state space). 

Theorem 1 Suppose [Kpf.pWejPe) is an irreducible CMS such that Ki,K 2 , 
...jKff partition K into non-empty open subsets, eachPelxn,,) is Dini-continuous 
and there exists h > 0 such that Pe\Kn for all e G E. Then: 

(i) The CMS has a unique invariant Borel probability measure p, and p{Ki) > 0 
for all 1 = 1,..., N. 

(a) If in addition the CMS is aperiodic, then 


f{x) p{f) for all X G K and f G Cb{K) 


and the convergence is uniform on bounded subsets, i.e. p is an attractive prob¬ 
ability measure of the CMS. 

A function h : {X, d) —> M is called Dini-continuous iff for some c > 0 
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where 4> is the modulus of uniform continuity of /, i.e. 

(t>{t) := sup{|h(x) - h{y)\ : d{x,y) <t, x,y £ X}. 

It is easily seen that the Dini-continuity is weaker than the Holder and stronger 
than the uniform continuity. There is a well known characterization of the 
Dini-continuity. 

Lemma 1 Let 0 < c < 1 and b > 0. A function h is Dini-continuous iff 

OO 

cj) (be") < OO 

n—0 

where (j) is the modulus of uniform continuity of h. 

The proof is simple (e.g. see US])- 

Furthermore, with a Markov system (^Ki(^f,'j,We,Pe) which has an invariant 
Borel probability measure y, also is associated a measure preserving transfor¬ 
mation S : (Ti, B(T,), M) —> which we call a generalized Markov 

shift, where E := {(..., cr_i, cro: o'!: ■•■) : cr^ £ i? Vz G Z} is the code space pro¬ 
vided with the product topology, B(Yj) denotes Borel cr-algebra on S and M is 
a generalized Markov measure on ;B(S) given by 

M (m[ei, ...,efe]) := j Pe,_(x)pe 2 (WeiX)...Pek(Wek-i O ■■■ O WeiX)dp{x) 

for every cylinder set m[ei,...,efc] := {tr £ E : am = ei,am+k-i = Cfe}, 
m £ Z, and S is the usual left shift map on E. It is easy to verify that S 
preserves measure M, since U*p = p (see [T^i. 

For a CMS, this two pictures, Markovian and dynamical, are related by a coding 
map F : (E, B(E),M) —> K which was constructed in JHI- It is defined, if K 
is a complete metric space and each Pe\Ki{e) is Dini-continuous and bounded 
away from zero, by 

F(a) := lim ° o ... o w^^xp^A for M-a.e. cr £ E 

where Xi £ Ki for each i = (the coding map does not depend on the 

choice of Xi’s modulo an M-zero set). We show in this paper that F is also 
well defined under a weaker continuity condition on the probability functions 

PelKi(e)- 

Let denote by F the sub-cr-algebra on E generated by cylinder sets of the form 
m[em, eo], m < 0. Note that F is JF-f5(/f)-measurable. 

Example 1 Let G := (V,E,i,t) be a finite irreducible directed (multi)graph. 
Let Eg := {(..., (t_i, cto) : Cm S E and t(am) = z(o'm-i) Vm £ Z \ N} (be 
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one-sided subshift of finite type associated with G) endowed with the metric 
d{(j, a') := 2^ where k is the smallest integer with at = cr' for all fc < z < 0. Let 
g be a positive, Dini-continuous function on Eg such that 

g{y) = 1 for all x G Eg 

y6T-i({a;}) 

where T is the right shift map on E^. Set Ki := {cr G E^ : t(cro) = z} for every 
z G y and, for every e € E, 

We(cr) := (...,cr_i,cro,e), Pe(a) := g(..., cr_i, (Tq, e) for all cr G 

Obviously, maps {we)eeE are contractions. Therefore, (K^(gpWe,Pe )defines 
a CMS. An invariant probability measure of this CMS is called a g-measure. 
This notion was introduced by Keane [H] and further developed by Ledrappier 
EH, Walters dl, Berbee |2j and others. 

Example 2 Let be normed by ||.||i. Let Ki := {(x,y) G : z/ > 1} and 
K 2 := {ix,y) G : y < —1}. Consider the following maps on 



with probability functions 

Pi ( y ^ ll(2;:P)lli + 

P2 ( * ) := (^^cos^ ll(a:>y)lli + 

P3 ( y ^ := (^ sin^ ll(a;, p) II 1 + 1k2 (x, y) and 

P4 ( ^ ^ := (^^cos^ ll(a^.?/)lli + 0 ^kAx.v)- 

A simple calculation shows that (Arj(g),zCe,Pe)eG{i, 2 , 3 , 4 }) where z(l) = z(2) = 1 
and z(3) = z(4) = 2, defines a CMS with an average contracting rate 209/210 
on Ki U K 2 . Note that none of the maps are contractive (by Theorem it has 
a unique (attractive) invariant Borel probability measure). 


2 Main Part 

Let M := (iLi(e)) be a contractive Markov system with an average 

contracting rate 0 < a < 1 and an invariant Borel probability measure p. 
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We assume that: {K,d) is a metric space in which sets of finite diameter are 
relatively compact; the family Ki,...,K]\f partitions K into non-empty open 
subsets; each probability function _Pe|Ki(e) is uniformly continuous and bounded 
away from zero by <5 > 0; the set of edges E is finite and the map i : E —> V 
is surjective. Note that the assumption on the metric space implies that it is 
locally compact separable and complete. 

In contrast to the papers m, m and ESI, here we will prove some similar 
results under a weaker continuity condition on the probability functions PelK^^^ 
than the Dini-continuity. In Subsection 2.1, we show that the coding map is 
well defined under this condition. In Subsection 2.2, using the coding map, 
we set up a thermodynamic formalism for CMSs, which is beyond the scope 
of the existing theory. Finally, using the developed thermodynamic formalism, 
we show in Subsection 2.3 that the irreducible CMS A4 with the probabilities 
satisfying the following continuity condition has a unique invariant Borel 
probability measure, which also can be obtained empirically. 


Definition 1 We say that a function h : K —> R has a square summahle 
variation iff for any c > 0 


•PHt) 


dt < oo 


Jo t 

where (j) is the modulus of uniform continuity of h, i.e. 


cj){t) := sup{\h{x) - h{y)\ : d{x,y) <t, x,y G X} 


or equivalently, for any 6 > 0 and 0 < c < 1, 

CXD 

(&c") < oo, 

n—0 

which is obviously a weaker condition than the Dini-continuity and stronger 
than the uniform continuity. 


This condition was introduced by A. Johansson and A. Oberg in m, where they 
proved the uniqueness of the invariant probability measure for some iterated 
function systems with place-dependent probabilities satisfying this condition 
on a compact metric space. Shortly after that, it was announced by Berger, 
Hoffman and Sidoravicius jH] that the condition of the square summability of 
variation is tight, in the sense that for any e > 0 there exists a (^-function with 
a summable variation to the power 2 -|- e such that the corresponding CMS as 
in Example m has several invariant Borel probability measures. 


Example 3 Let a, (5 > 0 such that a -I- <5 < 1 and 0 < c < 1/e. Set 


p{x) 


log ■ 


(5 


if 0 < X < i 
if X = 0. 
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Let 4> be the modulus of uniform continuity of p. Then 
(/)(c") = —for all n G N. 

Hence p is not Dini-continuous, but obviously it has a square summable vari¬ 
ation. See m for a discussion of the relation between the Johansson-Oberg 
condition and the Berbee condition [2]- 

Let S'*' := endowed with the product topology of the discreet topologies. 
For X G K, let Px denote the Borel probability measure on given by 

Px (l[ei, ...,efe]) := Pe^{x)pe^{WeiX)...pek{Wek-i ° O We^x) 

for every cylinder set i[ei,...,efc] C E+. Obviously, Px represents the Markov 
process with the Dirac initial distribution concentrated at the point x. 

All results for CMSs with probabilities with a square summable variation which 
we intend to prove in this paper follow from the next lemma. It generalizes 
Lemma 3 in jH] and Lemma 2.3 in m- For the proof of it we use the method¬ 
ology of Johansson and Oberg Uni- 

Lemma 2 Suppose M- is a CMS such that each probability function PbIk^^^ has 
a square summable variation. Then Py is absolutely continuous with respect to 
Px for all x,y G Ki and i = 1 ,..., N. 


Proof. Let An be the tr-algebra on generated by the cylinders of the form 
i[ei,..., e„] for all n G N. For each n G N, let Xn be a function of S’*" given by 


Xnifj) 


E 

ei,...,e2 


Pyjl [ei; ■■■; Sn]) .. 

P.(i[ei,...,e„]) 




for all a G E"*" 


with the convention that 0/0 = 0. Obviously, by the definition of Px, we 
can restrict the summation in the definition of Xn on paths (ei,...,€„)* of the 
digraph. 

Now, observe that, for all to < n and Cm G Am, 


j Xn dPx 

Cm 


E 

CnCCm 


Pyipm) — J 


Xm. dPx. 


( 2 ) 


Hence, (X„,A„)„gN is a -martingale. If Xn is uniformly bounded, then 
there exists X G C^{Px) such that Xn X Px-a.e. and in sense, and 
Ep^{X\Am) = Xm Px-a.e. for all to (see 0). Then, by 0, 


X dPx= / Xm dPx = Py{Cm) for all Cm G An 
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It means that the Borel probability measures XP^ and Py agree on all cylinder 
subsets of S+j and therefore, are equal. This implies the claim. So, it remains 
to show that the martingale is uniformly integrable, i.e. 


sup 

n 


/ 


Xn>K 


XndPx ^ 0 as ^ oo. 


By 0, it is equivalent to show that 

supPy{Xn > K) ^ 0 as K ^ oo. 

n 

The latter is equivalent to 

sup Py {log Xn > K) ^ 0 as K ^ oo. 

n 


Let us use the following abbreviation: 

P“(ct) := Pai{Wai_i O ... O Wa^x) 

for i >2 and p“((t) := Pcri{x) for all cr G S~*". Then, since log a: < a: — 1, 


logX„ = 


__ 'ry^ T)^ 

H ...I 

n y 

E . 

(ei....,e„)* i=l 


< 


E E 

(ei,...,e„)* I—1 


p! -pf 




Now, observe that 

Therefore, 

where 


Pf-Pf Pf-Pf , {Pf-Pif 


V 

PI 


X V 

Pfp" 


log^n < Yn + Zn, 


yr^--= E E 


pf-pf 


y -Li[ei,...,en] 


(ei,. 


( 3 ) 


Zn 




p 




and 








Furthermore, observe that 


y,+i - Fi = ^ for all ^ > 1. 


(ei,...,e„)* 


V 

Pu+1 


and 


J (r„+i - y„) dPy 


l[ei,...,e„] 

Pe„+i(We„ 0-0Wei2/)-Pe„+i(We„ O...OWe,x) 


= E 


Cn + l 


Pe„+i(We„ O ...OWeiV) 


Xpei(2/)---Pe„(We„_i O O Wei J/)Pe„+i (We„ ^ ° We^v) 

= E ('^e„ O ...OWeiV) - Pe„+i (We„ O ...OWeiX)) 

e„+i 

XPei(2/)---Pe„(We„_i O ... O We^v) 

= 0 . 

Hence, (F„,^„)„gN is a Py -martingale. Therefore, F„ - F„_i, Fn_i - F„_2,..., 
F 2 — Fi, Fi are orthogonal in C‘^{Py). By the Pythagoras equality, this implies 
that 


F„2 dPy 


^ y (Fi - Fi_l)2 dPy + J Fl^ dPy 


^ E 




(pi-pf? .p 

^2 


1 ?i 

- ^E / b<Ti(w,^i_i o... dPj;. 

i=l -f 

Let 

Ai := |(T G : fi(wCTi o ... O Wa^y, Wa-i o ... O Wa^x) > d{x, ?/)| 
for i G N. By the contractiveness on average condition, 

J d{wai o ... o Wa^y, w^i o ... o Wa^x) dPy < a^d{x, y) for all i. 

Hence, by the Markov inequality, 

Py {Ai) < for all i. 
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Therefore 



< 


1 

i^l 

-. / oo oo \ 

^ (12^^ +12^^ {a^d{x,y)) 

\i=l i=l / 


for all n G N. Hence 


sup Py (Yn > K) ^ 0 S.S K ^ oo. 

n 


Analogously, 

sup Py {Zn > K) ^ 0 as K ^ oo. 

n 

Since, by m, 


{logX„>if}c 



u 



we conclude that 


supPy (logATn > K) ^ 0 as K ^ oo, 

n 


as desired. 


□ 


2.1 Coding map 

We shall denote by d! the metric on S defined by d'{a,a') := (1/2)^ where k is 
the largest integer with ai = cr- for all |i| < k. Denote by A the finite tr-algebra 
generated by the zero time partition {o[e] : e G P} of S, and define, for each 
integer m < 1, 

+ 00 

Am := V 

i=m 

which is the smallest tr-algebra containing all finite tr-algebras VlLm n > 

m. Let X G K. For each integer m < 1, let P™ be the probability measure on 
the tr-algebra Am given by 

P™(m[em, = Pem{x)Pem+i{We,„ix))...Pe,,iWe„_i O ... O W e„,{x)) 

for all cylinder sets m[em, e„], n > m. 

Lemma 3 Let m < 1 and A G Am- Then x i—> P^{A) is a Borel measurable 
function on K. 
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The proof is simple (see e.g. El)- 


Definition 2 Let v G P{K). We call a probability measure on (S, Am) 

given by 

^mH{A) := J P^{A)dv{x), A G Am, 

the m-th lift of v. 

Definition 3 Set 

C[B) := I {Am)m=o ■■ Am € Am Vw and B C IJ I 

I m=0 J 

for B C S. Let u G P{K). We call a set function given by 

$(i/)(5) := inf E ‘hm(^^)(^7Ti) ■ {Am)m<0 S i j C S, 


^ m—0 


the lift of v. 


Lemma 4 Let v,X ^ P{K)- Then 

(i) is an outer measure on S. 

(ii) If ^mir') ^ $m(A) for all m < 0 , then for all e > 0 there exists a > 0 such 
that 


4>(A)(S) < a ^ < e for all B C S. 


For the proof see [T^ . 

Note that M = $(^) (see ^HI)) where M is the generalized Markov measure 
associated with the CMS M and its invariant measure p,. 

Fix Xi G Ki for each i G {1, and set 

Pxi...XN Pxj^...xN := $ 

for every m G Z\N, where Sx denotes the Dirac probability measure concentrated 
at X, i.e. 

= ^Pem{Xi{em))Pem+l{'UJe,^Xi(^e^))...pe^{We„_iO...OWe^X,(^e„,)) 

for every cylinder set ml^m, ■■•,en]- 

Theorem 2 Let Xi,yi G Ki for each \ <i < N. Then the following hold. 

(^) 

lim d (wao OWa_^ o ... o W„^{Xi(„A,Waa OWa_^ O ... O = 0 

m—^ —oo V / / 


N 


—y 4 
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p 

J X\ . ..XN 

(ii) 


Fxi...xn ■= 1™ 'W<70°'Wa_iO ...OWa^{x^(^^) exists Pxi...xN-a.e., 

m^ — oo 

and by {i') Fx\...xn — Fy^...y^ Px\...xn ~(^-e.. 

(Hi) There exists a sequence of elosed subsets Qi C Q 2 C ... C S with 

00 

Pxi...x!^{^\Qk) < 00 such that Fxi...xN\Qk locally Holder-continuous with 

k=l 

the same Holder-constants for all fc S N, i.e. there exist a, C > 0 such that for 
every k there exists Sk > 0 such that 

a, a' e Qk with d'{a,a') < 4 => d{Fx^...xN{^)^ Fx^...xm{^')) < Cd'{a,a')°‘. 
For the proof see [T^ . 

Lemma 5 Suppose (iFi(e), is a CMS such that Px is absolutely eon- 

tinuous with respect to Py for all x,y G Ki, i = Let vi £ P(K) such 

that vi{Ki) > 0 for all i = Then $(^' 2 ) is absolutely continuous with 

respect to $(z^i) for all V 2 £ P{K). 

Proof. By Lemma 0 (**), it is sufficient to show that ^m{k' 2 ) is absolutely 
continuous with respect to for all to < 0. Let A £ Am such that 

^m{k'i){A) = 0. Then for all i = 1,...,A^ there exists Xi £ Ki such that 
P™(A) = 0. Hence, by the hypothesis, PJf^{A) = 0 for all x G K. Therefore, 

‘hm(*^i)(^) = J dv 2 (x) = 0 for all 1/2 £ P{K), 


as desired. □ 

Corollary 1 Suppose (iFi(e), is a CMS with an invariant Borel prob¬ 

ability measure /i such that Px is absolutely continuous with respect to Py for all 
x,y G Ki, i = 1,..., A^. Let Xi,yi £ Ki for each 1 < i < N. Then the following 
hold. 

(^) 

lim d (wao O W<T _1 O ... O Wa^{Xilc^\),Wca o Wa_i o ... o Wa^{yi{o„,))) = 0 M-a.c., 
(ii) 

Fxi...xn '■= lim WaoOWa _,^0 ...OWcr^{Xirm)) exists M-a.e., 

m —>• —oo 

and by (i) Fx.,...xn = ^yi...yiv M-a.e.. 

(Hi) There exists a sequence of closed subsets Qi C Q 2 C ... C H with 

lim M(S \ Qk) = 0 sueh that Fx.,^...XN\Qk Is locally Holder-continuous with the 

k—*oo 
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same Holder-constants for all fc £ N, i.e. there exist a,C > 0 such that for 
every k there exists Sk > 0 such that 

a, a' G Qk with d'{a,a') < Sk ^ < Cd', 

where M is the generalized Markov measure associated with the CMS and fi. 

Proof. Set 

1 ^ 
i=l 

Since M = 0(^), the claim follows by Theorem [2 and Lemma |2 □ 

2.2 The generalized Markov measure as an equilibrium 
state 

Now, we are going to set up a thermodynamic formalism for the CMS At. We 
will construct an energy function u with respect to which the generalized Markov 
measure M will turn out to be a unique equilibrium state if the probabilities 
Pelic-c^of the CMS have a square summable variation. This extends the results 
from 1^ . 

Definition 4 Let A be a metric space and T a continuous transformation on 
it. Denote by P{X) the set of all Borel probability measures on X and by 
Pt{X) the set of all T-invariant Borel probability measures on X. We call a 
Borel measurable function h : X —> [—cx),0] an energy function. Suppose that 
T has a finite topological entropy, i.e. snpQ^p.^(^x) de(T) < oo, where h^lT) is 
the Kolmogorov-Sinai entropy of T with respect to measure 0. We call 

P{h) = sup (fie(T) + 0(/i)) 

the pressure of h. We call A G PriX) an equilibrium state for h iff 

hA{T) + A{h) = P{h). 

Let’s denote the set of all equilibrium states for h by ES{h). 

The construction of the function u goes through a definition of an appropriate 
shift invariant subset of S on which the energy function shall be finite. This 
subset is exactly that on which the coding map is defined. It means that the 
existence of an equilibrium state is closely related with the existence of the 
coding map. 

Definition 5 Let 


Eg := {cr G S : t{(jj) = i{(Jj+i) Vj G Z}, 
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and 


D ■= {a & Sg : lim Wag 



exists} 


m —> — oo 


oo 


Y:= f] S^iD). 


i— — oo 


Now, set 



logpo-i ° Y{cr) if cr e y 
—oo if tJ G S \ y. 


(4) 


Lemma 6 (i) F{a) is defined for all a € Y and Y is a shift invariant subset 
ofYa. 


(a) If Px is absolutely continuous with respect to Py for all x,y G Ki, i = 
I,N, then M (y) = 1. 

(Hi) If Px is absolutely continuous with respect to Py for all x,y G Ki, i = 
1, N, and the CMS has an invariant probability measure y such that p{Ki(^f.)) > 
0 for all e G E. Then Y is dense in Eg- 

Proof, (i) is clear, by the definitions of F and Y. Note that the condition of 
the contractiveness on average and the boundedness away from zero of the func¬ 
tions Pe|_ffj(e) imply that each map WelK^,,-) is continuous (Lipschitz). Therefore, 
S{D) C D. By Corollary m M{D) = 1 if is absolutely continuous with 
respect to Py for all x,y G Ki, i = This implies {ii). If in addition 

> 0 for all e G E, then M{0) > 0 for every open O C Eg- This implies 

{Hi). □ 

Remark 2 (i) Note that Y and F depend on the choice of Xi’s. By Corollary 
m (ii), y changes only modulo M-zero set by a different choice of Xi’s if Px is 
absolutely continuous with respect to Py for all x,y G Ki, i = 1,..., N. 

(ii) If all maps WsIkh,.) are contractive, then Y = Eg and PIeq is Holder- 
continuous (easy to check). 

Remark 3 As far as the author is aware, the rigorous mathematical theory of 
equilibrium states is developed only for upper semicontinuous energy functions h 
(see e.g. [HI)- This condition insures that the convex space ES{h) is non-empty 
and compact in the weak* topology. However, as the next example shows, u 
is not upper semicontinuous in general. Therefore, even the existence of an 
equilibrium state for u is not guaranteed by the existing theory. 

Example 4 Let {K,d) = (M, |.|). Consider two maps 


wo(x) := —X, wi(x) := 2x for all a: G M 


with probability functions 


Then a simple calculation shows that (R, We,Pe)eG{o,i} defines a CMS with an 
average contracting rate 45/48. In this case, ’Sq = {0,1}^. If we take x = 0 for 
the definition of Y, then, obviously, Y = Yg- Now, let x ^ 0. Let A^on(o') and 
Nin{cr) be the numbers of zeros and ones in (ct_„, ..., cro) respectively for every 
a £ Eg- Then, obviously, a ^ Y if {Nin{a) — iVon(o')) —> oo. Hence, Y ^ Eg 
and, by LemmaEI (iii), F is a dense shift invariant subset of Eg- Since Y is not 
closed, u is not upper semicontinuous. 

Also, it is not difficult to see that in a general case there is no hope to find Xi 
such that u becomes upper semicontinuous, e.g. change wi to wi{x) = 2x + 1, 
then, for any choice of x for the definition ofY,Y ^ Eg- 

Proposition 1 There exists an invariant Borel probability measure p of the 
CMS A4 such that 

N 

/ d{x, Xi) dp{x) < oo for all Xi G iCi, f = 1,..., N. 

Proof. Fix Xi G Ki for all i = 1,..., and set 

N 

fix) := lKiix)dix,Xi) for all x G K. 

i=l 


Let C := m.axdiweXi(^e)iXt(^f.))- Then the contractiveness on average condition 
m implies that 

fixi) < ^ for all /c G N and i = 1, 

1 — a 


(see the proof of Theorem 1 in USD. 


Now, set 


Un ■■ = 


1 

n 


k=l 


for all n G N. 


By Theorem 1 (i) from m, the sequence is tight. Hence, the 

sequence (17n*(5xJnGN is tight also. So, it has a subsequence, say 
which converges weakly* to a Borel probability measure, say p. By the setup of 
A4, the operator U has the Feller property. This implies that U*p = p. 


Let R> 0 and fn := min{/,i?}. Then 


Un,„*5xiifR) pifn) as m ^ (X). 


On the other hand 

UnJSx.ifR) < — < 

rim 


C 

1 — a 
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for all m £ N. Hence 


KIr) < i~r^ i? > 0. 


Therefore, by the Monotone Convergence Theorem, 



X, Xi) d^{x) 


m(/) < 



□ 


Proposition 2 Suppose Ai is a CMS such that Px is absolutely continuous 
with respect to Py for all x,y G Ki, i = 1, Then ES{u) is nonempty. 

Proof. By Proposition the CMS has an invariant Borel probability measure 
fj, such that 


d{x, Xi) dp{x) < oo for all Xi £ Ki, i = 1,..., N. 
Furthermore, by LemmaEI (it), 



M{Y) = 1, 

where M is the generalized Markov measure associated with M. and p,. Hence, 
by Proposition 1 in m, M is an equilibrium state for u. □ 

Lemma 7 Let A £ ES{u) and A £ Ps(S) such that A is absolutely continuous 
with respect to A. Then A £ ES(u). 


Proof. Let if be the Radon-Nikodym density of A with respect to A. By the 
shift invariance of A and A, tf o S = if. This implies that 


Ea{jP\E) = Ea{^\E) o S A-a.e.. 
Let A G P and e G E. Then 


dA 


y li[e]V’ O S' dA = j lg[e]EAi'^l^\iF) dA 

.4 S{A) 

J l,[e]EAmP) dA = j EA{l,[e\\E)EA{if\P) dA 
A A 

J EAil,le]\E)lf dA = j EA{l,[e\\E) dA. 

A A 
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Hence 


= ■E^A(li[e]|-^) A-a.e.. 
Since A is an equilibrium state for u, 

li[e] log£'A(lqe]|J^) = u A-a.e., 

eeB 


by Lemma 5 in |2nj . 

A, 


Therefore, by the absolute continuity of A with respect to 
Y logA^A(li[e]l-?^) = u A-a.e.. 

eeE 


Therefore, 


^(*5) = -Y [ d'A 

= ~ J Y li[e]log^A(liHl-^) d-A 


eeE 

= — u dA. 


Since P{u) = 0 (see e.g. [201), it follows that A G ES{u). 


□ 


Proposition 3 Suppose AA is CMS such that Px is absolutely continuous with 
respect to Py for all x,y G Ki, i = Then there exists an ergodic 

equilibrium state A for the energy function u such that A is absolutely continuous 
with respect to M where M is a generalized Markov measure associated with 
the CMS and its invariant Borel probability measure p with the property that 
Sill Sk- dfi{x) < oo for all Xi G Ki, i = 1 ,..., N. 


Proof. By Proposition ^ there exists an invariant Borel probability measure 
p of the CMS such that EiLi dp(x) < oo for all Xi G Ki, i = 

By Proposition 1 in (JOj, M is an equilibrium state for u. Since S 
is a compact metric space, it is well known that PsCE) is a compact (in the 
weak* topology) convex space. By the Krein-Milman Theorem, Ps{E) is a 
closed convex hull of its extreme points, which are exactly the ergodic measures 
(see e.g. Theorem 6.10 in CH). Furthermore, the ergodic measures can be 
characterized as the minimal elements of the set Ps(S) with respect to the 
partial order given by the absolute continuity relation (see e.g. [2], Lemma 
2.2.2) (to be precise, the absolute continuity relation is a partial order on the 
equivalence classes consisting of equivalent measures, but every equivalence class 
containing an ergodic measures consists of a single element). Therefore, there 
exists an ergodic A £ Ps(S) such that A is absolutely continuous with respect 
to M. Thus, by LemmaQ A G ES{u). □ 
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Theorem 3 Suppose CMS Ai has a unique invariant Borel probability measure 
/i and M{Y) = 1, where M is the associated generalized Markov measure. Then 
the following hold. 

(i) M is a unique equilibrium state for the energy function u, 

(ii) P{u) = 0, 

{in) F{M) = p., 

{iv) hM{S) = -X;ee£;/K,(,)PelogPe dp. 

For a proof see m- 

2.3 Uniqueness and empiricalness of the invariant proba¬ 
bility measure 

Now, we are going to show that an irreducible CMS with probabilities with 
square summable variation has a unique invariant probability measure and it 
can be obtained empirically. 

Before we move to the main theorem, we need to clear up some technical details. 

Let V G P{K). Since x i—> Px{Q) is Borel measurable for all Q G 6(S+) (see 
e.g. Lemma 1 in m), we can define 

(i){u){AxQ) := J P^{Q)di^{x) 

A 

for all A G B{K) and Q G B{T,~^). Then ^{v) extends uniquely to a Borel 
probability measure on K x S+ with 

^{v){^l) = J Px ({cT G S’’" : {x, cr) G fl}) di'{x) 

for all n G {K x S’*'). Note that the set of all C Lf x for which the 
integrand in the above is measurable forms a Dynkin system which contains all 
rectangles. Therefore, it is measurable for all {K x S+). 

Now, consider the following map 

^ KxY+ 

a I—> (F(ct), ((71,(72,...)). 

Lemma 8 Suppose M. is a CMS with an invariant Borel probability measure 
p such that d(x, Xi) dp{x) < oo for all Xi G Ki, i = 1,...,N, and 

M{Y) = 1, where M is the generalized Markov measure associated with A4 and 
p. Let A £ T’s(S) be absolutely continuous with respect to M. Then 

e(A)=^(F(A)). 
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Proof. We only need to check that 


^(A) (A Xi [ei, ...,e„]+) = <i>iF{A)) (A Xi [ci, ...,e„]+) 
for all cylinder sets i[ei, ...,en]'^ C E+ and A £ B{K). For such sets 
^(A) (a X 1 [ei,e„]^) = K{F ^(A) fii [ei,e„]) 

F-^A) 

where i[ei, C S is the pre-image of i[ei, ...,e„]+ under the natural pro¬ 

jection. Recall that F~^{A) £ T. Therefore, by Lemma 6 in |2nj . 

£^M(li[e] 1-^) =PeoF M-a.e.. 

Since A is absolutely continuous with respect to M, 

A^A(li[e] 1-^) =PeoF A-a.e., (5) 

analogously as in the proof of Lemma [3 This implies, by the shift invariance 
of A and the pull-out property of the conditional expectation, that 

.^A(li[ei,...,en] 1*^) ~ Fp(^(j) (i[ci, ^ A-a.e.. 

Therefore, 

J = J -PF(a) (i[ei, .•.,e„]+) dA(cr) 

F-^(A) F-i(A) 

= y iA (i[ei, ...,e„]+) dT(A)(x), 

A 

as desired. □ 

Theorem 4 Suppose A4 is an irreducible CMS such that Px is absolutely con¬ 
tinuous with respect to Py for all x,y G Ki, i = Then the following 

hold. 

(i) The CMS has a unique invariant Borel probability measure p. 

(a) Let fe : K —> [—cx), -|-oo] be Borel measurable such that felK^^-, is bounded 
and uniformly continuous for all e G E. Then, for every x G K, 

^ n—1 

- Y] Uk+l ° Wck ° 


... o Wai{x) 


ees 


Pefe dp for Px-a.e. cr £ S+. 


K, 


(e) 


Proof. By Proposition|S[ u has an ergodic equilibrium state A which is absolutely 
continuous with respect to M where M is the generalized Markov measure 
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associated with the CMS and its invariant Borel probability measure ^ with the 
property that /r: d{x,Xi) dij{x) < oo for all Xi £ Ki, i = This 

implies that A(y) = 1. Set 


V{(7) 


\ogfaiOF{a) if cr G y 
—oo if (T £ E \ Y. 


Then, by Birkhoff’s Ergodic Theorem, 


( 6 ) 


1 

n 


n—1 

E-os* 

k=0 


V dA A-a.e.. 


Since F o S'^{a) = o ... o Wai{F{a)) for all cr £ Y, we can assume, without 
loss of generality, that 


1 


E/- 




I Wo-i (A'(cr)) ^ J V dA for all a GY. 


By 10, 


V dA = lim ^ / lj[e]n A fe o F dA — lim ^ / Pe o Fn A fe o F dA 
= 1™ E / Pen A fe dF{A) = '^ f PefedF{A). 


g^E 

Kne) 

Now, applying the map f, we get 

n — 1 


eGE 


if. 


i(e) 


^ o_^ ^ r 

Pefe dF{A) for all {x,a) £ ^(Y). 

^ '==° 

By LemmalHl .^(F(A))(e(Y)) = e(A)(e(Y)) = A(r'(e(>^))) > A(Y) = 1. Since 
(j){F{A)) is a probability measure, 

1 = 0(F(A))(C(Y))=y'p4{a£E+:(x,a)£C(Y)})dY(A)(ai) 

AT 

= E / e ^ e ^(^)}) dFiA)ix). 


Furthermore, for each z = 1, there exists Xi £ Ki such that 


J P, {{a £ E+ : {x,a) £ ^(Y)}) dF{A)ix) 

Ki 

= P,, ({a £ E+ : (x„a) £ ^(Y)}) P(A)(iC,). 
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Set 

Qi := {ct e E+ : {xi,a) G ^(F)} . 

Then 

1 f 

lim - /o- o o ... o (Xi) = / Pefe dF{A) for all a G Qi, 

n^oo 77, ^ ^ / 

fe=0 e^Ef^ 

^i(e) 


and 


AT 


y] (g.) F(A) (i^o = 1. 


Note that, since A is an equilibrium state for u, U*F{A) = F{A) (e.g. Propo¬ 
sition 1 in 1201 ) • Thus, by the irreducibility of the CMS F{A){Ki) > 0 for 
all i = (see Lemma 1 in |16|i. This implies that Pa,. (Qi) = 1 for all 

i = as F{A) and are probability measures. Now, fix a: G iCi for 

some i G {!,..., A^}. Since Px is absolutely continuous with respect to Pxi, 
Px {Qi) = 1- Furthermore, the contractiveness on average condition Q implies 
that 

J d{Wcrk O ... O Waj {x), Wcr*, O ... O Waj (Xi)) dPx < a'"d{x, Xi). 

Therefore, it follows, by the Borel-Cantelli argument, that 

d{wak o ... o Waj^{x),Wai, o ... o Waj^{xi)) 0 Px-a..e.. 

As each fe\Kn^) is uniformly continuous, we conclude that 


lim 

T). — i-oc n ^ 


O Wau O O V^a 


A;=0 


(cc) = / PefedF{A) Px-a..e.. 

eeErQ 

KHe) 


Thus, the claim in (ii) will follow if we show that P(A) is the unique invariant 
Borel probability measure of the CMS. 

Let g G Cb{K) and set fe=g for all e £ E. Then the integration with respect 
to Px and Lebesgue’s dominated convergence theorem imply that 

. n — 1 

- E 

n 

Since x was arbitrary, again an integration and Lebesgue’s dominated conver¬ 
gence theorem imply that 

I n—1 

- E ^ Fi^) for all G P{K). (7) 

^ k^O 


J gdF{A) for all g G Cb{K). 
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Suppose U*X = X for some A G P{K). Then 

- n—1 

- V U*’"X = X for all n G N. 

n ^ 

k=0 

Therefore, F(A) = X. Hence, F{A) is a unique invariant probability measure of 
the CMS, i.e. F{A) = /z. □ 

The following corollary generalizes corresponding results from d, m, cni and 

d- 

Corollary 2 Suppose Ai is an irreducible CMS such that each has a 

square summable variation. Then the following hold. 

(i) The CMS has a unique invariant Borel probability measure p. 

(a) Let fe ■ K —> [— 00 , +CX)] be Borel measurable such that fe\Kn^) is bounded 
and uniformly continuous for all e € E. Then, for every x € K, 

1 f 

owa,, O ...owaiix) / p^fe dp for Px-a.c. (J & YC. 

k^O G^Erp- 

Ki(e) 

Proof. By Lemma El the measures Px and Py are absolutely continuous with 
respect to each other for all x,y G Ki, i = 1,..., Therefore, the claim follows 
by Theorem El ^ 

Corollary 3 Suppose Ai is an irreducible CMS such that each has a 

square summable variation. Then the following hold. 

(i) The generalized Markov measure M is a unique equilibrium state for the 
energy function u, 

{a) p{u) = 0 , 

{Hi) F{M) = p, 

(iv) hM{S) = -X;ee£;/ic,(,)^^elogPe dp. 

Proof. Since the CMS has a unique invariant Borel probability measure p (Corol¬ 
lary El and M{Y) = 1 (Lemma El (**)), the claim follows by Theorem Eland 
Theorem El n 

Finally, we would like to give an application of Theorem El (iv) which allows 
an empirical calculation of Kolmogorov-Sinai entropy hM{S) of the generalized 
Markov shift associated with a given CMS without knowing anything about its 
invariant measure. 

Corollary 4 Suppose Ai is an irreducible CMS such that Px is absolutely con¬ 
tinuous with respect to Py for all x,y G Ki, i = 1 ,..., N. Then for every x G K 

lim - log Px{i[(7i,..., a.^]) = -hM{S) for Px-a.e. cr G S+. 

n—*oo Ti 
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Proof. By Theorem 0(1) and Theorem 0 (iv), 

hM{S) = - logPed/r. 

eG-E 

Set fe ■= logpe for all e G E. Then, by Theorem^ (ii), for every x G K, 
lim - log[po-i (x)pcr 2 o Wai {x)...pa„ o o ... o (a::)] = -hM{S) 

n^oo Tl 

for Px-a.e. a G S+, as desired. □ 

Remark 4 The author would like to point out that a similar entropy formula 
as that proved in Theorem 0 (iv) plays a central role in the recent book of 
Wojciech Slomczynski m 

Remark 5 This paper contributes more to the mystery of an ergodic classifi¬ 
cation of the generalized Markov shifts associated with aperiodic CMSs. So far, 
we know only that they are strongly mixing if the restrictions of the probabil¬ 
ity functions on their vertex sets are Dini-continuous m and they are weak 
Bernoulli if in addition all maps are contractive (the latter is not difficult to see 
by reducing it to the corresponding result of P. Walters for the natural exten¬ 
sion of 51 -measures M since g := expuls^, is Dini-continuous in this case). H. 
Brebee [2] has shown the very weak Bernoulli property of the natural extension 
of g-measures on a full shift under a continuity condition on g which is weaker 
than the Dini-continuity and not comparable with the square summability of 
variation (see cni). From this paper, we only can see that an aperiodic gener¬ 
alized Markov shift is ergodic if the restrictions of the probability functions on 
their vertex sets have a square summable variation (Corollary0and Lemma0. 
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